Digital visual acuity eye examination for remote physician assessment

ABSTRACT

Systems and methods for assessing the visual acuity of person using a computerized consumer device are described. The approach involves determining a separation distance between a human user and the consumer device based on an image size of a physical feature of the user, instructing the user to adjust the separation between the user and the consumer device until a predetermined separation distance range is achieved, presenting a visual acuity test to the user including displaying predetermined optotypes for identification by the user, recording the user&#39;s spoken identifications of the predetermined optotypes and providing real-time feedback to the user of detection of the spoken indications by the consumer device, carrying out voice recognition on the spoken identifications to generate corresponding converted text, comparing recognized words of the converted text to permissible words corresponding to the predetermined optotypes, determining a score based on the comparison, and determining whether the person passed the visual acuity test.

CROSS REFERENCE TO RELATED APPLICATION

This application is related to United States Design patent applicationfiled even date herewith (Dec. 11, 2017), entitled “DISPLAY SCREEN ORPORTION THEREOF WITH GRAPHICAL USER INTERFACE FOR A VISION TEST,” andidentified by Attorney Docket No. 014473-0002-999, the entire contentsof which are incorporated herein by reference.

BACKGROUND Field of the Disclosure

The present disclosure relates to eye examinations and, in particular,to computer-based visual acuity examinations carried out without the useof optical refractor lens assemblies.

Background Information

Myopia, hyperopia, and astigmatism are common refractive errors of theeye that afflict many people. Myopia, typically referred to asnearsightedness, is a refractive defect of the eye in which images arefocused forward of the image surface of the retina. Hyperopia, typicallyreferred to as farsightedness, is a refractive defect of the eye inwhich images are focused in behind the image surface of the retina.Astigmatism is a refractive defect of the eye stemming from animperfection in spherical curvature of the optical system of the eye inwhich parallel rays of light are focused onto two different pointsrather than one common point at the image surface of the retina.

People traditionally have visited an eye doctor personally in the eyedoctor's office in order to obtain diagnosis of such eye conditions aswell as a prescription for purchasing corrective lenses such as contactlenses or spectacles. Such in-person visits to eye doctors may be costlyand time consuming, for example, by requiring an individual to take timeaway from work or from other obligations and travel to the location ofthe eye doctor's office to receive an eye examination.

Computerized eye examinations that do not require an in-person visitwith an eye doctor have arisen in part to address issues of thetime-consuming nature and cost of traditional, in-person eyeexaminations with an eye doctor. However, the present inventors haveobserved that existing computerized eye examinations themselves may beoverly complex and time consuming, and may provide less than optimalcustomer experience arising out of technical deficiencies inconventional computerized eye examinations. The present disclosureprovides technological solutions to such technological problems incomputerized eye examinations.

SUMMARY

The present inventors have observed that existing computerized eyeexaminations that may be taken with a personal computing device withoutin-person administration by an eye doctor may be overly complex and timeconsuming and may provide an unsatisfactory consumer experience shouldthe computerized eye examination need to be retaken because of technicaldeficiencies such as insufficient examination results data, ambiguousexamination results data, lack of verification of conditions suitablefor unassisted computerized eye examination, and lack of technicalfeedback to the user during the computerized eye examination. Thesechallenges arise in a technological context in computerized eyeexaminations and are not encountered with traditional in-person eyeexamination administered by an eye doctor using a traditional refractorlens assembly of the type commonly found in eye doctor offices.

The present disclosure may provide technical solutions to thesetechnological problems by providing a computerized eye examination,e.g., a visual acuity examination taken with the user wearing correctivelenses of an existing prescription, and taken with a personal consumercomputing device such as a laptop computer, tablet computer, smartphone, etc., without the need for administration of the exam by anin-person eye professional, wherein the computerized eye exam providesreal-time user feedback during the eye examination to enhance thereliability of eye examination data obtained and by using sophisticatedprocessing of eye examination data obtained by the personal computingdevice, either during the eye examination or promptly thereafter, toenhance the reliability of processed eye examination data. Exemplaryapproaches described herein may further provide screening of obtainedeye examination data by a human technician at a remote computer systemand further review of the (screened) eye-examination data by aphysician, who may reissue the prescription to permit the user tocomplete an online purchase of corrective lenses such as contact lensesor spectacles, and who may also assess the eye-examination data for anyconcerns and potentially recommend an in-person eye examination with aphysician for further assessment.

According to one exemplary aspect, a method for testing visual acuity ofa user using a computerized consumer device is described. Thecomputerized consumer device includes a display screen, a camera, amicrophone, a speaker, a computer processor, and a memory, and may be,e.g., a tablet computer, a smart phone, a personal computer such as adesktop, laptop or notebook computer, or the like. The user is a humansubject. The method includes: initiating a visual acuity test to assessthe visual acuity of a user using a computerized consumer device, thecomputerized consumer device, the user being a human subject;determining, by the computerized device, a separation distance between auser and the computerized consumer device based on an image size of aphysical feature of the person using imagery of the user taken by thecamera of the computerized consumer device; instructing, by thecomputerized consumer device, the user to adjust the separation betweenthe user and the computerized consumer device, and instruct the userthat a predetermined separation distance range is achieved; presenting,by the computerized consumer device, a visual acuity test to the userwithout use of a refractor lens assembly, wherein presenting the visualacuity test comprises displaying predetermined optotypes at the displayscreen of the computerized consumer device for the user to perceive;recording, at the computerized consumer device, spoken identificationsby the user of perceptions of the optotypes via the microphone of thecomputerized consumer device, and providing real-time feedback to theuser of detection of the spoken indications by the computerized consumerdevice; carrying out voice recognition on the user's spokenidentifications to generate converted text corresponding to the spokenidentifications; comparing recognized words of the converted text topermissible words corresponding to the predetermined optotypes using alookup table; determining a score for visual acuity test taken by theuser based on said comparing; and determining whether the user passedthe visual acuity test based on the score.

According to another exemplary aspect, a consumer-based system forcarrying out a visual acuity test of a user is described. The systemcomprises a computerized consumer device that includes a display screen,a camera, a microphone, a speaker, a computer processor, and a memory,and may be, e.g., a tablet computer, a smart phone, a personal computersuch as a desktop, laptop or notebook computer, or the like. The user isa human subject. The system may also include one or more serverscomputers that may access one or more databases to store and permitaccess to test results of vision tests taken by multiple users, as wellas remote computer systems for use by medical professionals, e.g.,screening technicians and physicians, for review and assessment ofvision test data and results, e.g., for approval of vision test resultsin order to permit renewing the eye prescriptions of users so that usersmay proceed to make online purchases of corrective lenses such ascontact lenses or spectacles. The computer processor is configured tocause the computerized consumer device to: initiate a visual acuity testto assess the visual acuity of a user using the computerized consumerdevice, the user being a human subject; determine a separation distancebetween a user and the computerized consumer device based on an imagesize of a physical feature of the person using imagery of the user takenby the camera of the computerized consumer device; instruct the user toadjust the separation between the user and the computerized consumerdevice, and instruct the user that a predetermined separation distancerange is achieved; present a visual acuity test to the user without useof a refractor lens assembly, wherein presenting the visual acuity testcomprises displaying predetermined optotypes at the display screen ofthe computerized consumer device for the user to perceive; record spokenidentifications by the user of perceptions of the optotypes via themicrophone of the computerized consumer device, and provide real-timefeedback to the user of detection of the spoken indications by thecomputerized consumer device; carry out voice recognition on the user'sspoken identifications to generate converted text corresponding to thespoken identifications; compare recognized words of the converted textto permissible words corresponding to the predetermined optotypes usinga lookup table; determine a score for visual acuity test taken by theuser based on said comparing; and determine whether the user passed thevisual acuity test based on the score.

According to another exemplary aspect, a non-transitory computerreadable medium comprising program instructions for permitting acomputerized consumer device to carry out a visual acuity test of a useris described. The computerized consumer device includes a displayscreen, a camera, a microphone, a speaker, a computer processor, and amemory, and may be, e.g., a tablet computer, a smart phone, a personalcomputer such as a desktop, laptop or notebook computer, or the like.The user is a human subject. The program instructions are configured to,when executed, causing a computer processor of the computerized consumerdevice to: initiate a visual acuity test to assess the visual acuity ofa user using the computerized consumer device, the computerized consumerdevice including a display screen, a camera, a microphone, a speaker, acomputer processor, and a memory, the user being a human subject;determine a separation distance between a user and the computerizedconsumer device based on an image size of a physical feature of theperson using imagery of the user taken by the camera of the computerizedconsumer device; instruct the user to adjust the separation between theuser and the computerized consumer device, and instruct the user that apredetermined separation distance range is achieved; present a visualacuity test to the user without use of a refractor lens assembly,wherein presenting the visual acuity test comprises displayingpredetermined optotypes at the display screen of the computerizedconsumer device for the user to perceive; record spoken identificationsby the user of perceptions of the optotypes via the microphone of thecomputerized consumer device, and provide real-time feedback to the userof detection of the spoken indications by the computerized consumerdevice; carry out voice recognition on the user's spoken identificationsto generate converted text corresponding to the spoken identifications;compare recognized words of the converted text to permissible wordscorresponding to the predetermined optotypes using a lookup table;determine a score for visual acuity test taken by the user based on saidcomparing; and determine whether the user passed the visual acuity testbased on the score.

According to another exemplary aspect, a method for testing visualacuity of a user using a graphical interface and an audio interface at acomputerized consumer device is described. The method comprises:initiating a visual acuity test to assess the visual acuity of a userusing a computerized consumer device, the computerized consumer devicecomprising a display, a camera, an audio interface including amicrophone and a speaker, a computer processor, and a memory, the userbeing a human subject, the visual acuity test comprising a graphicalinterface for displaying information to the user and for receiving inputfrom the user via touch sensitive fields; displaying, via the graphicalinterface, distance information of a measured distance between thecomputerized consumer device and the user measured from imagery of theuser captured by the camera of the computerized consumer device tothereby provide guidance to the user to move to a desired predetermineddistance range, the graphical interface being configured to dynamicallydisplay the distance information in real time as the measured distancechanges; displaying, via the graphical interface, the visual acuity testwithout use of a refractor lens assembly including displayingpredetermined optotypes for the user to perceive, and presenting audioinstructions for the visual acuity test via the speaker of the audiointerface; recording, via the microphone of the audio interface, spokenidentifications by the user of perceptions of the predeterminedoptotypes, and providing real-time visual feedback to the user via thegraphical interface indicative of detection of the spoken indications bythe computerized consumer device; carrying out speech recognition on theuser's spoken identifications to generate converted text correspondingto the spoken identifications; comparing recognized words of theconverted text to permissible words corresponding to the predeterminedoptotypes using a lookup table; determining a score for visual acuitytest taken by the user based on said comparing; and determining whetherthe user passed the visual acuity test based on the score.

BRIEF DESCRIPTION OF THE FIGURES

These and other features, aspects, and advantages of the presentdisclosure will become better understood with regard to the followingdescription, appended claims, and accompanying drawings.

FIG. 1 illustrates an exemplary framework for conducting a computerizedeye examination with a computerized consumer device according to anexemplary aspect.

FIG. 2 illustrates a flow diagram for an exemplary approach for carryingout a computerized eye examination including a visual acuity examinationwith a computerized consumer device according to an exemplary aspect.

FIG. 3 illustrates a flow diagram for an exemplary approach for carryingout eye surface imaging using a personal computing device according toan exemplary aspect.

FIGS. 4-6 illustrate exemplary introductory screens (which may also bereferred to as pages) of a graphical interface (also referred to as agraphical user interface or GUI) for a vision test presented via anapplication (or app) at a display screen of a computerized consumerdevice 400, such as a tablet or a smart phone, according to an example.

FIGS. 7-10 illustrate exemplary GUI screens of the app for enteringpatient information, according to an example.

FIGS. 11-16 illustrate exemplary GUI screens of the app for conductingeye surface imaging according to an example.

FIGS. 17-26 illustrate exemplary GUI screens of the app for conducting avisual acuity test, according to an example.

FIG. 27 illustrates an exemplary completion GUI screen of the appdisplayed at completion of the visual acuity test according to anexample.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

The present inventors have developed approaches for conveniently andreliably conducting vision tests (or examinations) using a computerizedconsumer device (or consumer computing device) such as a tabletcomputer, smart phone, personal computer such as a laptop computer,desktop computer, notebook computer, and the like. Vision test resultsmay be communicated to medical professionals, such as screeningtechnicians and physicians at remote computer systems, for review andassessment, such as described via examples herein. Such vision tests,including visual acuity tests and eye surface imaging, can be carriedout, for instance, in one's own home or other location without the needto travel to a doctor's office for an in-person eye examination with aneye doctor, and as described herein, may provide advantages overconventional computerized vision tests by providing real-time feedbackto the users during the tests to enhance the user experience, reducecomplexity, and promote the gathering of reliable test data. Such testscan provide convenience and lower cost and can be particularly desirablefor confirming the accuracy of existing (though perhaps expired) lensprescriptions to facilitate the online purchase of corrective lensesusing the most recent lens prescription.

FIG. 1 illustrates an exemplary framework for conducting a computerizedeye examination with a computerized consumer device according to anexemplary aspect. As shown in FIG. 1, a computerized consumer device102, such as a tablet computer, a smart phone, or a personal computersuch as a laptop computer, desktop computer, or notebook computer maypresent one or more vision exams to a user 104, who is a human subject.Computerized consumer device 102 may also be, for example a gamingdevice or other multimedia device. Computerized consumer device 102 mayinclude a touch sensitive display screen (which may also be referred toas a touchscreen display) 114, a speaker 116 that projects audio, acamera 118 (including a lens, lens cover, image sensor, and cameracircuitry), and a microphone 120 that permits collection of speechgenerated by the user. Vision tests may be presented to the user 104 viathe display screen 114 in the form of a series of screens (or pages) ofa graphical interface (also referred to as a graphical user interface orGUI) that present various test elements and instructions to the user,and that prompt the user for responses or instruct the user to takecertain actions. While one camera 118 is shown in FIG. 1, two or moreforward-facing cameras, i.e., cameras positioned at a same side of thedisplay screen 114 may be provided at the consumer device 102, e.g.,spaced apart from one another, e.g., at opposing edges of the consumerdevice 102, as to be able to obtain imagery of the user simultaneouslyfrom two or more different angles or orientations relative to the user.Also, one more additional rear-facing cameras may be provided at a sideof the consumer device 102 opposite the display screen 114. For example,speaker 116 and display screen (or touchscreen display) 114 may bothpresent instructions to the user 104, and touchscreen display 114 andmicrophone 120 may be used to record user responses or input to variousvision test elements or instructions.

Data gathered during the vision testing by computerized consumer device102 may be processed by device 102 and further communicated to remotecomputer systems 106 and 110 via a network 134 such as the Internet. Inthis regard, any suitable combination of wireless and wiredcommunication may be used, e.g., Wi-Fi, Bluetooth, etc. Remote computersystem 106 may serve as a technician screening system operated by atechnician 108, who may screen vision test data acquired by thecomputerized consumer device 102 via a display 114 b. Computerizedconsumer device 102 and remote computer systems 106 and 110 may accessdata from and communicate data to one or more server computers 130 whichmay access one or more databases 132 for storing data in any desiredformat. Remote computer system 110 may serve as a physician reviewcomputer's system operated by a physician 112, who may review via adisplay 114 c the vision test data, including imagery of the user'seyes, acquired by computerized consumer device 102 as well as screeningresults generated by the technician 108 that have been stored and areaccessible by the physician remote computer system 110 via the network134. In examples, in addition to, or instead of, display screens 114 band 114 c (each of which may comprise multiple display screens), thephysician 112 and technician 108 may view imagery of the user's eyesusing display devices such as virtual reality (VR) goggles,imagery-display headsets, and three-dimensional (3D) vision enhancementdevices configured to operate in conjunction with displays 114 b, 114 cor other displays, e.g., to permit stereoscopic or multiscopic viewingof eye surface imagery with three-dimensional (3D) depth perception ofsuch imagery (where eye surface imagery is obtained simultaneously fromtwo or more different directions with multiple forward facing cameras118 of the consumer device 102).

The computerized consumer device 102 includes a computer processor 122a, which may include one or more computer processing units (CPUs), andwhich can be any suitable combination of general purpose and specialpurpose processors. The consumer device 102 also includes one or morememories 124 a, which may include RAM, ROM, and any suitable nonvolatilememory. Memory 124 a may be used to store the instructions that executethe vision test app, data entered by the user, vision test resultsgenerated by the vision test app, as well as any associated metadata.The computerized consumer device 102 may also include one or moreinterfaces 114 a to facilitate communication via networks including theInternet and for facilitating input/output of data, e.g., cellularcommunication transceiver, Wi-Fi transceiver, Bluetooth transceiver, aswell as wired interfaces for communication and peripheral connection. Itwill be appreciated that the combination of speaker 116 and microphone120 along with associated circuitry may comprise an audio user interfacethat permits the user 104 to both perceive audio data from thecomputerized consumer device 102 and provide audio data to thecomputerized consumer device. Computerized consumer device 102 alsoincludes a GPS (mobile positioning system) receiver for detecting alocation of the consumer device 102.

Likewise, remote computer system 106 (e.g., technician screeningcomputer) includes a computer processor 122 b, which may include one ormore CPUs, one or more memories 124 a, which may include RAM, ROM, andany suitable nonvolatile memory, and one or more interfaces 114 a tofacilitate communication via networks including the Internet and forfacilitating input/output of data. Remote computer system 106 may alsoinclude one or more database(s) 128 b to facilitate the storing of datain desired formats. Similarly, remote computer system 110 (e.g.,physician review computer) includes a computer processor 122 c, whichmay include one or more CPUs, and one or more memories 124 c, which mayinclude RAM, ROM, and any suitable nonvolatile memory, one or moreinterfaces 114 c to facilitate communication via networks including theInternet and for facilitating input/output of data, and one or moredatabase(s) 128 c to facilitate the storing of data in desired formats.

Remote computer systems 106 and 110 may store a variety of data inmemories 124 b, 124 c and databases, 128 b, 128 c and 132 to support theadministration, execution, processing, and review of vision tests asdescribed herein. Such data may include, for example, medical historyinformation of users 104, vision test results users 104, processed datagenerated by remote analysis and processing of vision test results ofusers 104, imagery acquired from vision tests for users 104 includingvideo imagery and still imagery, GPS location data associated with users104, screening comments and determinations made by screening technician108, physician review comments and determinations made by physician 112,and the like.

Exemplary approaches for exemplary vision testing using a computerizedconsumer device will now be described with reference to FIGS. 2 and 3and with further reference to FIGS. 4-27. In this example, GUI screensand audio instructions of a vision test app are presented via a displayscreen 114 and speaker 116 of a computerized consumer device 102, suchas a tablet or a smart phone as previously mentioned, and user 104 inputis recorded via the touchscreen display 114 and via the microphone 120,which receives the user's spoken responses. While this example describesconducting an eye-surface imaging test as well as a visual acuity testusing displayed optotypes (optical characters or symbols used in visiontesting), additional tests could also be carried out, such as, forexample, a color blindness test such as an Ishihara color blindness testknown in the art.

In addition to the steps described below, it may be desirable to takepreliminary steps to enhance the experience of the user. For example,according to some aspects, it may be advantageous to temporarily defeator suspend certain functionality at the consumer device 102 includingthe following so that such functionality is not executed during testing:automatic brightness control of the display screen 114 that mightotherwise result in unwanted screen dimming; automatic screen saverfunctionality that might otherwise change the screen; automatic popupmessaging that might obscure GUI screens of the test; and the like. Itwill be appreciated that GUI screens may be presented to the user 104 atthe consumer device 102 so that the user can grant permission for thevision test app to execute these temporary changes.

FIG. 2 illustrates a flow diagram for an exemplary approach for carryingout a computerized eye examination including a visual acuity examinationwith a computerized consumer device executing a vision testingapplication (app) according to an example. As shown at step 202, thecomputerized consumer device 102 receives a command to initiate a visiontest including a visual acuity test. Exemplary GUI screens forinitiating such vision testing using a vision test app according to thisexample are shown in FIGS. 4-5 (and FIG. 17). FIG. 4 illustrates anexemplary computerized consumer device 102 including touch screendisplay 114, speaker 116, camera 118, microphone 120, and control button115, such as previously described. In addition, a display area oftouchscreen display 114 is shown by a dotted line at 114 a. FIG. 4illustrates an exemplary first GUI screen of the app presented atdisplay screen 114. As shown in FIG. 4, in this example, the screen ispresented with a company name at the top, a name of the application(e.g., EXPRESS EXAM), and various introductory information identified byreference numeral 412. The GUI screen in FIG. 4 also includes anacknowledgment portion 414 with a check box to be checked by the user104 to acknowledge the user 104 understands that the vision test beingprovided is not a substitute for a comprehensive eye exam. The initialGUI screen in FIG. 4 also includes a field 414 for the user to touch tocontinue the exam.

After touching the “continue” field 414, a GUI screen shown in FIG. 5 isdisplayed. This GUI screen includes an instruction portion 416 directingthe user to make sure that the corrective lenses are presently beingworn, to find a quiet, well-lit area with, e.g., 10 feet of availablespace, and to inform the user that the test will need to access theuser's current location via GPS functionality. After pressing the “next”field 418 of the GUI, the app proceeds to display the GUI screen shownin FIG. 6. FIG. 6 shows an exemplary GUI screen that displays a maplocation 420 and that asks the user to confirm that the location iscorrect by pressing a “confirm location” field 422.

Returning to FIG. 2, at step 204, the computerized consumer device 102may receive user input of the user's patient information. Exemplary GUIscreens for this step of the vision test app are shown in FIGS. 7-10.The GUI screen shown in FIG. 7 includes an instruction portion 424asking for the user's age, the approximate date of the lastcomprehensive eye exam, and gender (optional). This screen also includesdata entry fields 426 that are responsive to user touch and permit theuser to enter the data via a pop-up keypad or via drop-down menus, e.g.,to select date information and gender, as may be appropriate, anexemplary result of which is shown in FIG. 8. Upon pressing the quotenext unquote field 432, the app proceeds to display the GUI screen shownin FIG. 9. The exemplary GUI screen shown in FIG. 9 permits the user 104to continue to enter patient information by indicating at checkbox field434 whether the user has had an eye infection, had eye surgery, or usedprescription eye drops since the last in person eye examination. Theuser 104 is also prompted to enter via checkbox field 436 (of FIG. 9)and checkbox field 438 (of FIG. 10) any listed conditions that the user104 has experienced. In this regard field 438 represents a continuationof field 436 that the user may access by scrolling down word using afinger stroke against the touchscreen 114. After completion of the eyehealth survey illustrated in FIGS. 9-10, the user may advance to thenext portion of the app by pressing the “continue” field 440.

Returning to FIG. 2, the method 200 includes at step 206 carrying outeye surface imaging using the camera 118 of the computerized consumerdevice 102. This eye surface imaging test (which may also be referredto, e.g., as an eye surface test or eye irritation test) may be carriedout either before or after a visual acuity test and captures imagery ofthe user's eye surfaces using video imaging and/or still imaging topermit the physician 112 to evaluate any readily apparent conditions ofconcern, for example, excessive redness in the user's eyes. ExemplaryGUI screens of the vision test app for carrying out this step are shownin FIGS. 11-16, and an exemplary flow diagram illustrating exemplarysteps for the eye surface test is illustrated in FIG. 3. Details of theeye surface test associated with step 206 will be described later hereinwith reference to FIGS. 3 and 11-16.

In the instant example, the visual acuity test can be conducted eitherbefore or after the eye surface test, and the visual acuity test can beinitiated for example with the GUI screen shown in FIG. 17. As shown inFIG. 17, this GUI screen includes a message indicating to the user thatthe visual acuity test will now be carried out. This exemplary GUIscreen also includes an information/instruction portion 466 informingthe user that the test will use the microphone 120 to record the user104 responses, and instructs the user visually via the display screen114 to stand the consumer device 102 upright or have a friend hold itwith the screen 114 facing the user 104. This exemplary GUI screen alsoinstructs the user, while facing the screen 114, to back up until theuser 104 is a predetermined distance, e.g., 10 feet, away from theconsumer device 102. All these instructions can also be provided audiblyvia the speaker 116.

The user 104 may advance the vision test app to the actual vision testby touching the “begin visual acuity test field 468.” Because the user104 may have limited ability to accurately determine whether or not theuser 104 is at the proper predetermined distance, the method 200illustrated in FIG. 2 includes a step 208 of automatically determiningby the computerized consumer device 102 in real-time the separationdistance between the user and the computerized consumer device 102 basedon an image size of the physical feature of the user based on imagery ofthe user taken by the camera 118.

More particularly, for example, the camera 118 may capture real-timeimagery of the user, and the computer processor 122 a of thecomputerized consumer device 102 may process that imagery in real-timeto calculate a distance from the consumer device 102 to the user basedon an image size of a physical feature whose actual physical size iseither known or assumed known, e.g., in an average or median sense. Anexample is illustrated in the GUI screenshots shown in FIGS. 18-19,which illustrate the consumer device 102 determining the distance to theuser 104 by carrying out facial detection processing and image analysisof the imagery to determine the apparent image size in pixels of theimage sensor of the user's head (e.g., height, width, and/or area) orthe pixel distance on the image sensor between the user's eye pupils.Thus, the distance determination may be based on imaging anatomicalfeatures of the user 104. Because the pupillary distance and head sizehave known average or median values, a calibration can be stored in thememory 124 a of the consumer device 102 of the proper expected pixeldistance between imaged pupils of the user's eyes or the proper expectedimage size in pixels of the user's head (e.g., width, height, and/orarea). Referring to step 210, the consumer device 102 can instruct theuser to adjust the separation between the user and the computerizedconsumer device 102 and inform the user that a predetermined separationdistance range is achieved. In this regard, the separation distancebetween the user 104 in the consumer device 102 need not be precisely adesired predetermined value but may be within a range of accepted valuessuch as within 10% of the a particular predetermined distance value,within 5% of the particular predetermined distance value, otherpercentage, or other threshold deviation from the particularpredetermined distance value. When the real-time imaging and analysis ofthe measured size in pixels of a suitable physical feature (e.g.,pupillary distance measured in pixels, or head size measured in pixels)matches the proper expected pixel values, the computer processor 122 aof the consumer device 102 can cause the consumer device 102 to audiblyinform the user 104 via the speaker 120 and/or visually inform the uservia the display screen 114 that the user has reached the properpredetermined distance. Thus, for example, the separation distance canbe determined simply with the computerized consumer device and withoutthe use of an additional distance detection sensor or mechanism otherthan that provided by the camera and processing of imagery acquired bythe camera as explained above.

For example, as illustrated in FIG. 12, an instruction 472 to adjustposition may be presented to the user 104 both visually on the displayscreen 114 as well as audibly via the speaker 116. In addition, forexample, the detected image of the user may be displayed on the displayscreen 114 in real-time, and an indicator 468 such as a circle with agraphical meter portion 466 as well as a textual numerical distanceindicator 470 may be displayed on the display screen 114 real-time aswell to guide the user with real-time feedback to the proper distanceand proper orientation relative to the consumer device 102, e.g., sothat the user's face is approximately centered on the display screen114. Audio instructions may also be provided, e.g., such as “back up” or“too far.” As shown in FIG. 19, when the proper distance has beenobtained, and indicator 474 may be presented on the display screen 114e.g., a checkmark in a circle, to indicate that the user has reached theproper distance, and/or an audible confirmation may be presented to theuser via the speaker 116. Of course, the physical feature is not limitedto anatomical features such pupillary distance between the user's eyesor the size of the user's head, and other physical features of knowndimensions may also be used for this analysis, such as, a credit card orother object of known size held near the user's face or chest. In thelatter case, suitable instructions may be provided to the user 104 tohold up a predetermined common object of known size.

When the predetermined distance range has been achieved such asillustrated in FIG. 19, the consumer device 102 can automaticallyproceed to display optotypes on the display screen 114 to carry out thenext portion of the visual acuity test. In this regard, as noted at step212, the consumer device 102 presents the visual acuity test to the userincluding presenting predetermined optotypes at the display screen 114of the computerized consumer device 102 for the user 104 to perceive.The optotypes are presented for the user's perception without use of arefractor lens assembly of the type commonly seen in eye-doctor offices.Examples of GUI screens of the optotype portion of the visual acuitytest are shown in FIGS. 20-25. As shown in FIG. 20, a GUI screen can bedisplayed on the display screen 114 presenting an instruction graphic476 for the user to cover her right eye, and an audio instructioninstructing the user to cover her right eye may also be presented at thesame time via the speaker 116. The GUI screen at FIG. 20 alsoillustrates an audio indicator 478 graphically displayed on the displayscreen 114 with a portion 480 that indicates the ambient sound leveldetected via the microphone 120. The vision test app automaticallyproceeds to display the GUI screen shown in FIG. 21 which comprises anoptotype portion 482 including one or more optotypes to be perceived bythe user 104. The vision test app then audibly instructs the user 104 toread or identify the characters (or other optotypes as the case may be)displayed on the screen 114. Thus, for example, the presentation of thepredetermined optotypes may be done solely with the display screen ofthe computerized consumer device and without the use of an additionalseparate and distinct screen or other object located elsewhere inproximity to the user for presenting the predetermined optotypes.

When the user 104 audibly reads her perceptions of the characters (orother optotypes) displayed, as noted at step 214 of FIG. 2, the consumerdevice 102 records the audio identifications by the user 104 of herperceptions of the predetermined optotypes. In addition, the consumerdevice 102 provides real-time feedback to the user indicating that theuser's audio identifications were detected by the consumer device 102.This feedback can be provided, for example, by graphically displaying onthe screen 114 the audio indicator 478 and the portion 480 that isproportional to the detected sound level of user's spoken audioidentifications. In this way, the consumer device 102 provides real-timefeedback to the user that the test is proceeding normally so as to avoiduser confusion about whether or not the device 102 properly captured theuser's spoken responses to the displayed optotypes.

Thereafter, the vision test app automatically proceeds to display theexemplary GUI screen shown in FIG. 22, in which a new graphic 484 isdisplayed on the display screen 114 instructing the user 104 to coverthe left eye. An audio instruction is also conveyed through the speaker116 for the user 104 to cover the left eye, and an audio instruction isprovided to the user 104 to read the optotypes shown at portion 486 ofthe display screen 114 in FIG. 23. The consumer device 102 likewiserecords the user 104 responses (step 214), and provides real-time soundlevel feedback to the user 104 via indicators 478 and 480, such asmentioned above. Thereafter, the vision test app automatically proceedsto display the exemplary GUI screen shown in FIG. 24, in which a newgraphic 488 is displayed on the display screen 114 instructing the userto leave both eyes uncovered. An audio instruction is conveyed throughthe speaker 116 for the user 104 to leave both eyes uncovered, and anaudio instruction is provided to the user 104 to read the optotypesshown at portion 490 of the display screen 114 in FIG. 25. The consumerdevice 102 likewise records the user 104 responses (step 214), andprovides real-time sound level feedback to the user 104 via indicators478 and 480, such as mentioned above.

The predetermined optotypes may be displayed at the display screen 114of the computerized consumer device 102 in all instances is withoutchanging a size of the predetermined optotypes displayed on the displayscreen 102 from a first size to a second size based on the separationdistance between the user 104 and the computerized consumer device 102as determined by the computerized consumer device 102. This is becausethe separation distance has already been achieved to which apredetermined distance range as explained previously. The sizes of theoptotypes are configured to be consistent with proper visual acuitytesting for the particular distance for which the visual acuity test isconfigured, but there is no need for dynamic changes to the sizes of theoptotypes based on measured distance between the user 104 and consumerdevice 102.

As will be appreciated, various optotypes may be used for the visualacuity testing, including, but not limited, Snellen optotypes such asthose described above. Any suitable optotypes may be used, for example,Landolt C optotypes, which comprise a sequence of broken rings with gapspresented in different directions (e.g., up, down, left, right) can alsobe used, “tumbling E” optotypes, which comprise “E” shaped symbols withthe “fingers” thereof pointing, for a given orientation, in anassociated direction, e.g., left, right, up, or down, geometric symbols(e.g., circle, square, triangle, star, diamond, etc.), mathematicalsymbols (e.g., divided by, plus, times, minus), common objects (ball,scissors, pencil, etc.), fruits (e.g., apple, banana, pear, strawberry,etc.), animal shapes, or any other suitable shapes that may service asdistinctive symbols for use as optotypes. or other optotypes presentlyknown in the art or later developed. Suitable lookup tables may becreated for suitable optotypes such as taught by examples discussedbelow.

Upon completion of recording user responses to the displayedpredetermined optotypes, the vision test app may automatically proceedto display the exemplary GUI screen shown in FIG. 26, which shows agraphic 492 informing the user that the visual acuity test is complete.The exemplary screen also asks the user to confirm that she remained atthe predetermined distance, e.g., 10 feet, from the screen 114 of theconsumer device 102 and that the user 104 covered the eyes as directed.This GUI screen also includes a touch field 494 that permits the user104 to answer in the negative and retake the test, and includes a touchfield 496 that permits the user to answer in the affirmative andcontinue. The vision test app may then automatically proceed to displaythe GUI screen illustrated in FIG. 27, which includes a graphic 498informing the user that the eye examination is complete, that the testresults have been submitted for review, that the physician 112 willreview the test results, and that the user's corrective lens order willbe shipped upon confirmation by the physician 112 that the test has beenpassed. In this regard, it may be noted that an attempt to purchasecontact lenses may have preceded the visual acuity test and may have, infact, permitted the user 104 to navigate to the visual acuity test, upona determination that the user's current prescription for correctivelenses had expired. Reissuance of a corrective lens prescription in thismanner may be used to permit a user to purchase contact lenses orspectacles, either online from online optical retailers or in-person atany brick-and-mortar optical retailer.

After the user's spoken responses have been recorded (step 214), asnoted at step 216, voice recognition can then be carried out on theaudio identifications to generate converted text corresponding to theaudio identifications the optotypes spoken by the user 104. Any suitablespeech recognition algorithm, such as those conventionally known in theart, may be used in this regard. Additionally, this step can be carriedout either at the consumer device 102 or at a remote computer systemsuch as, for example, one or more of the remote computer systems 106,110. At step 218 of FIG. 2, recognized words of the converted text maybe compared to permissible words corresponding to the predeterminedoptotypes spoken by the user 104 using a lookup table. In this regard,it may be noted, for example, that the lookup table may comprisemultiple entries of permissible words for at least a given one of thepredetermined optotypes. In other word's, the lookup table may be amulti-to-one lookup table in the sense that speech recognition may yieldseveral, different legitimate words that may correspond to a singlegiven optotype (letter character or other graphic). As an example, Table1 below illustrates a hypothetical lookup table:

TABLE 1 O N F D E H R K L C o n f d e h r k l c oh nn eff dee ee acheare kay el see owe hen if day he che our chi elle sea an hour hell siIt should be appreciated that a word in this context may include withinits scope a single alphabetical letter, e.g., corresponding to anoptotype letter of a Snellen chart, and is not limited to multi-letterwords. However, if desired, the lookup table may be configured toinclude only multi-letter words and to exclude single, isolatedalphabetical letters.

As shown in Table 1, several potential results of speech recognitionmight be returned by the speech recognition engine for a givenletter-character optotype. Determining whether the user 104 hascorrectly identified displayed optotypes can be done by taking intoaccount these variations. Also, the lookup table can be updated bycarrying out data analytics on visual acuity test results gathered frommultiple, e.g., many users 104 who have taken the visual acuity test. Inparticular, for example, test results from multiple instances of thevisual acuity test taken by multiple users 104, and the lookup table maybe updated to adjust entries based on the analysis. For instance, it maybe determined that certain words should be added to the lookup table andothers should be removed based on analysis of user data. It should beunderstood that both the speech recognition and the lookup tablecomparison can be carried out at either the consumer device 102 or at aremote computer system such as one or more of remote computer systems106, 110.

In addition, it should be understood that speech recognition andassessing a user's audible answers for correct responses with a lookuptable as noted above is not limited to the example of a visual acuitytest utilizing Snellen optotypes. Exemplary visual acuity testingutilizing speech recognition on spoken user responses and lookup tablesfor evaluating the user's responses can be carried out utilizing anysuitable optotypes. For example, Landolt C optotypes, which, as notedabove, comprise a sequence of broken rings with gaps presented indifferent orientations can be used, for instance, in which case theuser's spoken responses may identify whether the “C” is “open” or“closed” for sequences of same-size or different-size optotypes, and inwhich case the a suitable lookup table can be developed to list suitableresponses representative of correct answers. In this example, the user104 could also be prompted to specify whether the gap in “C” ispositioned at the “left,” “right,” “top,” or “bottom,” and suitablelookup tables can be developed to list a collection of words thatrepresent correct answers. As another example, “tumbling E” optotypes,which, as noted above, comprise “E” shaped symbols with the “fingers”thereof pointing, for a given orientation, in an associated direction,e.g., left, right, up, or down, in which case the user's spokenresponses may identify whether the fingers of the “E” positionedpointing “left,” “right,” “up,” or “down” for sequences of same-size ordifferent-size optotypes, and suitable lookup tables can be developed tolist a collection of words that represent correct answers. Otheroptotypes can likewise be used, including but not limited, to geometricsymbols (e.g., circle, square, triangle, star, diamond, etc.) and anyvariety of distinctive shapes such as mathematical symbols (e.g.,divided by, plus, times, minus), common objects (ball, scissors, pencil,etc.), fruits (e.g., apple, banana, pear, strawberry, etc.), animalshapes, or any other suitable shapes. Regardless of the optotypes,suitable lookup tables can be prepared to list words that can correspondto correct responses.

In addition, prior to carrying out the portion of the visual acuity testin which optotypes are displayed on the display 114 and the user's audioidentifications are recorded, a sound level test can be carried out todetermine whether the user's speech and testing conditions are, in fact,sufficient to permit visual acuity testing involving the optotypedisplay portion of the test (before the user 104 undertakes that portionof the test). For example, the user can be instructed to repeat a phrasespoken by the device 102 in order to analyze a speech sample of the userusing the microphone 120 of the computerized consumer device 102, withthe user 104 and computerized consumer device 102 being separated by thepredetermined separation distance range. The computer processor 122 acan then calculate a voice quality metric based on audio processing ofthe speech sample, and determine whether the voice quality metric issufficient to permit visual acuity testing prior to displaying thepredetermined optotypes on the display screen of the computerizedconsumer device 102. For example, the voice metric may include asound-level intensity test of the user's voice relative to an ambientsound level, or the voice metric may be a more complex metric, such asinvolving an analysis of frequencies attributable to the user's voicerelative to ambient frequencies. Such a voice quality test prior topresenting the optotypes can improve the consumer experience by avoidingan attempt to collect full test data when sound conditions are notsufficient to do so. If the computer processor 122 a determines that thesound conditions are not suitable, it can cause the consumer device 102to audibly inform the user 104 via the speaker 116 that the test needsto be aborted due to insufficient vocal recognition and audibly informthe user 104 to move to a more quiet location and/or speak more loudlyand repeat the test. Reference data for what constitutes sufficientvocal recognition in order for the optotype recognition port of thevisual acuity test to proceed can assembled by trial and error testingof various sound levels and/or frequency levels permit speechrecognition to be done reliably.

Returning to FIG. 2, at step 220, a score can be determined for theuser's visual acuity test based on the comparison of the recognizedwords of the converted text to permissible words corresponding to thepredetermined optotypes. The score can be any suitable numerical scoresuch as a percentage of correct responses, a simple number of correctresponses, or a score level determined based on achieving a certainthreshold of correct responses. At step 222, a determination can be maderegarding whether the user passed the visual acuity test based on thescore, e.g., achieved a sufficient number of correct responses to pass.The scoring and the pass/fail determination can be made automatically bythe consumer device 102, automatically by a remote computer to whichresults were communicated such as remote computers 106, 110, and/or byadditional review by the screening technician 108 and/or physician 112.At step 224, the outcome of the visual acuity test can be communicatedto the user 104 by any suitable means, such as, for example, asubsequent GUI screen at consumer device 102 communicating the outcome(e.g., “you passed”), email, text message, voicemail, regular mail, etc.A copy of the renewed prescription may also be communicated. Where aneye surface test is also being conducted, it may be desirable as apractical matter to report the results of the visual acuity test alongwith the results of the eye surface test. In that case, where the eyesurface test involves review of eye surface imagery (recorded videoimagery and/or recorded still imagery) by a physician 112, it may beprefereable to refrain from reporting results of the visual acuity testto the user 104 until the physician 112 has reviewed the eye surfacetest imagery and rendered a decision on whether the eye test as a wholehas been passed, e.g., such that a current prescription may be renewed,and such that the user 104 may proceed to order corrective lensesonline.

In addition, in the unlikely event that there are any ambiguities ordeficiencies in the test data obtained from the user 104 by the consumerdevice 102 during the visual acuity test, complete video and audiorecordings of the visual acuity test may be captured by the consumerdevice 102, such that any such ambiguities or deficiencies can beresolved upon review by the screening technician 108 and/or thephysician 112. Such review and resolution by medical professionals ofany potential deficiencies or ambiguities in test data can improve thecustomer experience by avoiding a need to instruct the user 104 torepeat the vision test when a repeat of the vision test is not, in fact,necessary. Upon final review and assessment by such medicalprofessionals, test results may then be communicated to the user 104.

Returning to FIG. 2, it was previously mentioned that step 206 relatingto carrying out eye surface imaging using the camera 118 of the consumerdevice 102 would be later described in more detail. That description isnow presented. In this regard, FIG. 3 illustrates a flow diagram for anexemplary method 300 for carrying out eye surface imaging according tostep 206 of FIG. 2. Reference will also be made to FIGS. 11-16. As shownat step 302 of FIG. 3, the consumer device 102 may receive a usercommand to commence eye surface imaging with the consumer device 102 tocapture imagery of the user's eye surfaces to permit the physician toevaluate any readily apparent conditions of concern, for example,excessive redness in the user's eyes. The exemplary GUI screen in FIG.11 includes an information portion 422 explaining that this test willuse a camera such as camera 118 of the computerized consumer device 102to photograph the surfaces of the user's eyes, instructing the user tohold the device 102 about 1 foot from the users face, and to turn up thevolume on the consumer device 102 and follow the audio prompts. Theconsumer device 102 may also present these instructions audibly via thespeaker 116. The eye-surface imaging test is initiated when the userpresses the “begin surface test” field 444 at which point, the visiontest app proceeds to display the exemplary GUI screen shown in FIG. 12on the display screen 114.

As noted at step 304 of FIG. 3 and as illustrated in FIG. 12, theconsumer device 102 displays a GUI screen that displays a silhouettegraphic 446, e.g., of an approximate head shape, oval, or other suitableoutlining shape, of predetermined size on the display screen 114 andactivates the (forward facing) camera 118 to begin acquiring anddisplaying real-time video imagery of the user 104, though the imageryneed not necessarily be recorded and stored on a memory at this stage.As noted at step 306, while the real-time imagery of the user 104 isbeing acquired and displayed on the display screen 114 along with thesilhouette 446, the consumer device instructs the user to position theconsumer device 102 relative to the user 104, thereby providingreal-time visual feedback to the user for proper positioning of thecomputerized consumer device 102. The computer processor 122 a carriesout facial detection on the real-time imagery of the user 104 andprocesses the imagery of the user 104 to determine when the users faceis properly positioned relative to the consumer device by being alignedwith the silhouette 446. For example, as noted at step 308 the computerprocessor 122 a can determine when the separation distance between theuser 104 and the consumer device 102 and/or camera alignment satisfythresholds for capturing eye surface images, e.g., when the separationdistances is determined to be about 12 inches. For example the computerprocessor 122 a can carry out dynamic facial detection and compare thehead size and position of the imagery of the user 104 to the size andposition of the silhouette 446 by analyzing the pixel placements ofeach, e.g., as mapped to pixels of the image sensor of the camera 118 oras mapped to pixels of the display screen 114. Additionally oralternatively, the computer processor 122 can, for example, detect andmonitor the pixel distance between the user's pupils until that distancecorrespondence corresponds to an expected pixel distance that would beobtained at a 12 inch separation between the consumer device 102 and theuser's face, e.g., based on known average or median values of pupillarydistance for a population of human subjects. At step 310, the consumerdevice 102 can inform the user 104, e.g., with an audible and/or visualmessage, that proper positioning of the consumer device 102 has beenachieved relative to the users face and that eye surface imaging willcommence.

As shown at step 312 of FIG. 3, the consumer device 102 can instruct theuser 104 to position the user's eyes in a first predetermined position,e.g., “Look Left,” and can acquire first eye surface imagery of theuser's eyes in the first predetermined position using the forward facingcamera 118 (or using two or more forward facing cameras to capture suchimagery simultaneously from two or more angles or orientations relativeto the user's eyes). This imagery may comprise video imagery and/orstill imagery. In examples, capturing imagery of the eyes simultaneouslyfrom two or more different angles or orientations relative to the usermay permit stereoscopic or multiscopic imagery (e.g., video or stillimagery) of the eyes to be later viewed by the physician withthree-dimensional (3D) depth perception using, e.g., suitable 3Dglasses, virtual reality (VR) goggles, and the like. An example ofcapturing imagery according to step 312 is illustrated by the exemplaryGUI screen shown in FIG. 13, which shows the user's head substantiallyaligned with the silhouette 446 (to within suitable approximationtolerances, such as discussed elsewhere herein), and which shows aninstruction portion 452, which in this example states “Look Left.” Theconsumer device 102 may also issue an audio instruction to “Look Left.”The consumer device 102 may then capture the eye surface imagery of theuser's eyes by either waiting a predetermined time after giving theinstruction, e.g., 1 second, 2 second, 3 second, etc., or by detectingproper positioning of the user's eyes using facial detection analysis asdescribed elsewhere herein.

Upon capture of the eye surface imagery in the first predeterminedposition, the consumer device 102 may automatically proceed to instructthe user 104 to position her eyes in a second predetermined position andacquire second eye surface imagery of the eyes in the secondpredetermined position (step 314). An example is illustrated in FIG. 14,which shows a GUI screen including the silhouette 446 and superimposedwith the real-time imagery of the user 104, and which includes aninstruction portion 454 “Look Up.” The consumer device 102 may alsoissue an audio instruction to “Look Up.” The consumer device 102 maythen capture the eye surface imagery of the user's eyes by eitherwaiting a predetermined time after giving the instruction, e.g., 1second, 2 second, 3 second, etc., or by detecting proper positioning ofthe user's eyes using facial detection analysis. This imagery maycomprise video imagery and/or still imagery.

Upon capture of the eye surface imagery in the second predeterminedposition, the consumer device 102 may automatically proceed to instructthe user to position her eyes in a third predetermined position andacquire third eye surface imagery of the eyes in the third predeterminedposition (step 316). An example is illustrated in FIG. 15, which shows aGUI screen including the silhouette 446 and superimposed with thereal-time imagery of the user 104, and which includes an instructionportion 456 “Look Right.” The consumer device 102 may also issue anaudio instruction to “Look Right.” The consumer device 102 may thencapture the eye surface imagery of the user's eyes by either waiting apredetermined time after giving the instruction, e.g., 1 second, 2second, 3 second, etc., or by detecting proper positioning of the user'seyes using facial detection analysis. This imagery may comprise videoimagery and/or still imagery. The imagery of the eye surfaces may thenbe communicated to remote computer system(s) 1016, 110 for access andreview by medical professional(s), such as technician 108 and physician112, e.g., along with the results (user responses) of the visual acuityexamination obtained from the user (step 318).

Upon completing the acquisition of the eye surface test imagery of theuser's eyes, the vision test app may display the exemplary GUI screenshown in FIG. 16, indicating that the surface test is complete andseeking confirmation from the user 104 of following proper testconditions. For example, the GUI screen may include an informationportion 458 that includes a completion graphics such as a checkmarkinside a circle accompanied by the language “Surface Test Complete” or“Eye Irritation Check Complete.” In addition, the GUI screen may includea question portion 460 asking whether the consumer device 102 was a thedesignated distance, e.g., about 1 foot, from the user's face andwhether the user 104 followed the prompts. Also displayed is a touchfield 462 that permits the user to answer in the negative and retake theeye surface test, and a touch field 464 that permits the user to answerin the affirmative and continue. In this example, continuing maycomprise moving on to another vision test, such as a visual acuity testas previously described, a colorblindness test, or some other visiontest. Alternatively, if the eye surface imaging test is the final testin the series, continuing may comprise completing the testing sessionand entering an acknowledgment in a touch field such as touch field 499in FIG. 27 that testing is complete.

In connection with step 318, medical professionals, such as technician108 and physician 112, may review eye surface imagery of the user's eyesalong with user responses (results) of the visual acuity test. Asmentioned previously, this imagery may comprise video imagery and/orstill imagery, and such imagery of the eyes may be capturedsimultaneously from two or more different angles or orientationsrelative to the users. In examples, the physician and technician maytherefore review the eye imagery using stereoscopic or multiscopicviewing of video imagery or still imagery of the eyes three-dimensional(3D) depth perception using, e.g., suitable 3D glasses, virtual reality(VR) goggles, and the like. This may permit the physician 112 to viewadditional perspective information for the imagery of the eye surfacesin assessing whether the corrective lens prescription of the user 104may be renewed, whether any conditions of potential concern are apparentin the eye surface imagery, and/or may permit the physician 112 toprepare additional recommendations to be communicated to the user 104,such as, for example, informing the user 104 to seek an in-person eyeexamination at a physician's office.

As noted above, facial detection analysis may be used to detect when theuser's eyes are in proper position for eye surface imaging, and this canbe beneficial when it is desired to capture high-resolution still imagesof the surfaces of the user's eyes, which may not be available viarecorded real-time video imagery for eye surface imaging. Image analysisfor facial detection is generally known in the art, and any suitablefacial detection technique may be utilized. For example, Apple's“Vision” API framework may be utilized in iOS devices, and Google's“Face” API framework for Android devices to detect a user's face andfeatures thereof relative to other scene imagery. In addition, facedetection and analysis algorithms, such as OpenCV (Open Source ComputerVision Library) known in the art may be used to detect a user's face andfeatures thereof relative to other scene imagery. After detecting theuser's eyes, image processing can be used to detect the portions ofwhite color at the user's imaged eyes at a lateral left half of the eyeand a lateral right half of the eye in order to determine whether suchmeasurements satisfy one or more thresholds to determine that the user'seyes are pointing sufficiently right or sufficiently left in order toacquire eye surface images at those predetermined positions.Alternatively, or in addition, image processing may be used to detectthe position of the black pupils of the user's eyes to determine whethera given position of a pupil satisfies a right-position threshold or aleft-position threshold to determine that the user's eyes are pointingsufficiently right or sufficiently left in order to acquire eye surfaceimages at those predetermined positions. Likewise such APIs can beutilized, after detecting the user's eyes, to detect the proportion ofwhite color at the user's imaged eyes at a lower half (or upper half) ofthe eyes in order to determine whether that proportion satisfies athreshold to determine that the user's eyes are pointing sufficiently up(or down) in order to acquire eye surface images and those predeterminedpositions. While such measurements may be made for both eyes of the user104, it should be understood that such a measurement or measurements forone eye of the user 104 may suffice, because both eyes are expected tomove in unison. Additional information regarding known facialrecognition technology that may be applicable is disclosed, for example,in Yang et al., “Detecting faces in images: A survey,” IEEE Transactionson Pattern Analysis and Machine Intelligence, Vol. 24, No. 1, 2002, pp.34-58, Hjelmas et al., “Face detection: A Survey,” Computer Vision andImage Understanding, Vol. 83, No. 3, 2001, pp. 236-274, and U.S. Pat.Nos. 9,832,452, 9,053,354, 8,811,726, 8,442,327, 8,254,691, and7,372,981, the entire contents of each of which are incorporated hereinby reference.

The methods and systems described herein may be implemented using anysuitable computer processing system with any suitable combination ofhardware, software and/or firmware. As shown in FIG. 1, for example,computerized consumer devices 102 with which users 104 can take visiontests can communicate with remote computer systems 106 and 110 as wellas computer servers 130 that may access databases 132 via network 134.Remote computer system 106 and 110 may also be hosted on one or morecomputer servers 130 via a network such as network 134. The computerprocessors 122 a, 122 b, 122 c, etc., may execute software operations,program instructions or routines to implement calculations and analysesdescribed herein. Such program instructions, accumulated data, andprocessed data may be stored one or more non-transitorycomputer-readable memories 124 a, 124 b, 124 c, using databases 128 b,128 c, 132, etc. Communications may be carried out according to a clientserver architecture whereby computerized consumer devices 102 used byusers 104 access the remote computer systems 106, 100 and/or servercomputers 130 via one or more networks 134.

The systems may include element managers, real-time data buffers,conveyors, file input processors, database indices, data buffers anddata managers for managing data and processing. The systems 102, 106,110 may also include multiple displays, display interfaces, input/outputdevices such as a keyboards, microphones, mice, touch screens and thelike for permitting users, support personnel, and medical personnel tomanage the systems 102, 106, 110.

This written description describes exemplary embodiments of theinvention, but other variations fall within scope of the disclosure. Forexample, the systems and methods may include and utilize data signalsconveyed via networks (e.g., local area network, wide area network,internet, combinations thereof, etc.), fiber optic medium, carrierwaves, wireless networks, etc. for communication with one or more dataprocessing devices. The data signals can carry any or all of the datadisclosed herein that is provided to or from a device.

The methods and systems described herein may be implemented on manydifferent types of processing devices by program code comprising programinstructions that are executable by the device processing system. Thesoftware program instructions may include source code, object code,machine code, or any other stored data that is operable to cause aprocessing system to perform the methods and operations describedherein. Any suitable computer languages may be used such as C, C++,Java, HTML, XML, etc., as well as APIs available to developers for givenoperating system platforms, as will be appreciated by those skilled inthe art. Other implementations may also be used, however, such asfirmware or even appropriately designed hardware configured to carry outthe methods and systems described herein.

The systems' and methods' data (e.g., associations, mappings, datainput, data output, intermediate data results, final data results, etc.)may be configured for storage using any suitable data structures, andmay be stored and implemented in one or more different types ofcomputer-implemented data stores, such as different types of storagedevices and programming constructs (e.g., RAM, ROM, Flash memory, flatfiles, databases, programming data structures, programming variables,IF-THEN (or similar type) statement constructs, etc.). It is noted thatdata structures describe formats for use in organizing and storing datain databases, programs, memory, or other non-transitorycomputer-readable media for use by a computer program.

The computer components, software modules, functions, data stores anddata structures described herein may be connected directly or indirectlyto each other in order to allow the flow of data needed for theiroperations. It is also noted that a module or processor includes but isnot limited to a unit of code that performs a software operation, andcan be implemented for example as a subroutine unit of code, or as asoftware function unit of code, or as an object (as in anobject-oriented paradigm), or as an applet, or in a computer scriptlanguage, or as another type of computer code. The software componentsand/or functionality may be located on a single computer or distributedacross multiple computers depending upon the situation at hand.

It should be understood that as used in the description herein andthroughout the claims that follow, the meaning of “a,” “an,” and “the”includes plural reference unless the context clearly dictates otherwise.Also, as used in the description herein and throughout the claims thatfollow, the meaning of “in” includes “in” and “on” unless the contextclearly dictates otherwise. In addition, as used in the descriptionherein and throughout the claims that follow, the meanings of “and” and“or” include both the conjunctive and disjunctive and may be usedinterchangeably unless the context expressly dictates otherwise; thephrase “exclusive or” may be used to indicate situation where only thedisjunctive meaning may apply. In addition, as used in the descriptionherein and throughout the claims that follow, the meaning of “about”and/or “approximately” refers to ±10% of the quantity indicated, unlessotherwise indicated.

While the present invention has been described in terms of exemplaryembodiments, it will be understood by those skilled in the art thatvarious modifications can be made thereto without departing from thescope of the invention as set forth in the claims.

What is claimed is:
 1. A method for testing visual acuity of a userusing a computerized consumer device, the method comprising: initiatinga visual acuity test to assess the visual acuity of a user using acomputerized consumer device, the computerized consumer devicecomprising a display screen, a camera, a microphone, a speaker, acomputer processor, and a memory, the user being a human subject;determining, by the computerized device, a separation distance between auser and the computerized consumer device based on an image size of aphysical feature of the person using imagery of the user taken by thecamera of the computerized consumer device; instructing, by thecomputerized consumer device, the user to adjust the separation betweenthe user and the computerized consumer device, and instructing the userthat a predetermined separation distance range is achieved; presenting,by the computerized consumer device, a visual acuity test to the userwithout use of a refractor lens assembly, wherein presenting the visualacuity test comprises displaying predetermined optotypes at the displayscreen of the computerized consumer device for the user to perceive;recording, at the computerized consumer device, spoken identificationsby the user of perceptions of the predetermined optotypes via themicrophone of the computerized consumer device, and providing real-timefeedback to the user of detection of the spoken indications by thecomputerized consumer device; carrying out speech recognition on theuser's spoken identifications to generate converted text correspondingto the spoken identifications; comparing recognized words of theconverted text to permissible words corresponding to the predeterminedoptotypes using a lookup table; determining a score for visual acuitytest taken by the user based on said comparing; and determining whetherthe user passed the visual acuity test based on the score.
 2. The methodof claim 1, wherein the lookup table comprises multiple entries ofpermissible words for at least a given one of the predeterminedoptotypes.
 3. The method of claim 1, comprising: displaying a silhouetteof an approximate head shape of predetermined size on the display screenand activating the camera; instructing the user to position thecomputerized consumer device relative to the user while displaying theuser's imaged head in real-time relative to the silhouette to providereal-time feedback to user for proper positioning of computerizedconsumer device; determining that at least one of a separation distancebetween the user and the computerized device and a camera alignmentrelative to the user's face satisfy thresholds for capturing eye surfaceimages; and capturing imagery of eye surfaces of the user's eyes usingthe camera of the computerized consumer device.
 4. The method of claim3, wherein capturing the imagery of the eye surfaces of the user's eyescomprises: processing imagery of the user's eyes by real-time imageanalysis to detect that an orientation of the user's eyes are in aproper position; acquiring still imagery of the user's eyes with theuser's eyes in the proper position; and storing the still imagery fordesignation as eye-surface imagery.
 5. The method of claim 3, whereincapturing the imagery of the eye surfaces of the user's eyes comprisescapturing the imagery of the eye surfaces simultaneously from multiplecameras at the computerized consumer device, the multiple cameras beingspaced apart from one another to thereby obtain the imagery of the eyesurfaces from multiple different orientations.
 6. The method of claim 1,comprising: acquiring a speech sample of the user using the microphoneof the computerized consumer device with the user and computerizedconsumer device being separated by the predetermined separation distancerange; calculating a voice quality metric based on audio processing ofthe speech sample; and determining whether the voice quality metric issufficient to permit visual acuity testing prior to displaying thepredetermined optotypes on the display screen of the computerizedconsumer device.
 7. The method of claim 1, comprising suspending anautomated brightness control of the display of the computerized deviceprior to presenting the visual acuity test.
 8. The method of claim 1,wherein displaying predetermined optotypes at the display screen of thecomputerized consumer device is carried out without changing a size ofthe predetermined optotypes displayed on the display screen based on theseparation distance between the user and the computerized consumerdevice determined by the computerized consumer device.
 9. The method ofclaim 1, comprising: analyzing test results from multiple instances ofthe visual acuity test taken by multiple users; and updating the lookuptable to adjust entries thereof based on said analyzing.
 10. The methodof claim 1, wherein the computerized consumer device comprises tabletcomputer, a smart phone, or a personal computer.
 11. A consumer-basedsystem for carrying out a visual acuity test of a user, comprising: acomputerized consumer device, the computerized consumer device includinga display screen, a camera, a microphone, a speaker, a computerprocessor, and a memory, the computer processor being configured tocause the computerized consumer device to: initiate a visual acuity testto assess the visual acuity of a user using the computerized consumerdevice, the user being a human subject; determine a separation distancebetween a user and the computerized consumer device based on an imagesize of a physical feature of the person using imagery of the user takenby the camera of the computerized consumer device; instruct the user toadjust the separation between the user and the computerized consumerdevice, and instruct the user that a predetermined separation distancerange is achieved; presenting a visual acuity test to the user withoutuse of a refractor lens assembly, wherein presenting the visual acuitytest comprises displaying predetermined optotypes at the display screenof the computerized consumer device for the user to perceive; recordspoken identifications by the user of perceptions of the predeterminedoptotypes via the microphone of the computerized consumer device, andprovide real-time feedback to the user of detection of the spokenindications by the computerized consumer device; carry out speechrecognition on the user's spoken identifications to generate convertedtext corresponding to the spoken identifications; compare recognizedwords of the converted text to permissible words corresponding to thepredetermined optotypes using a lookup table; determine a score forvisual acuity test taken by the user based on said comparing; anddetermine whether the user passed the visual acuity test based on thescore.
 12. The system of claim 11, wherein the lookup table comprisesmultiple entries of permissible words for at least a given one of thepredetermined optotypes.
 13. The system of claim 11, the computerprocessor being configured to cause the computerized consumer device to:display a silhouette of an approximate head shape of predetermined sizeon the display screen and activating the camera; instruct the user toposition the computerized consumer device relative to the user whiledisplaying the user's imaged head in real-time relative to thesilhouette to provide real-time feedback to user for proper positioningof computerized consumer device; determine that at least one of aseparation distance between the user and the computerized device and acamera alignment relative to the user's face satisfy thresholds forcapturing eye surface images; and capture imagery of eye surfaces of theuser's eyes using the camera of the computerized consumer device. 14.The system of claim 13, the computer processor being configured to causethe computerized consumer device to capture the imagery of the eyesurfaces of the user's eyes by: processing imagery of the user's eyes byreal-time image analysis to detect that an orientation of the user'seyes are in a proper position; acquiring still imagery of the user'seyes with the user's eyes being in the proper position; and storing thestill imagery for designation as eye-surface imagery.
 15. The system ofclaim 13, the computer processor being configured to cause thecomputerized consumer device to capture the imagery of the eye surfacesof the user's eyes by capturing the imagery of the eye surfacessimultaneously from multiple cameras at the computerized consumerdevice, the multiple cameras being spaced apart from one another tothereby obtain the imagery of the eye surfaces from multiple differentorientations.
 16. The system of claim 11, the computer processor beingconfigured to cause the computerized consumer device to: acquire aspeech sample of the user using the microphone of the computerizedconsumer device with the user and computerized consumer device beingseparated by the predetermined separation distance range; calculate avoice quality metric based on audio processing of the speech sample; anddetermine whether the voice quality metric is sufficient to permitvisual acuity testing prior to displaying the predetermined optotypes onthe display screen of the computerized consumer device.
 17. The systemof claim 11, the computer processor being configure to cause thecomputerized consumer device to suspend an automated brightness controlof the display of the computerized device prior to presenting the visualacuity test.
 18. The system of claim 11, the display of thepredetermined optotypes at the display screen of the computerizedconsumer device being carried out without changing a size of thepredetermined optotypes displayed on the display screen based on theseparation distance between the user and the computerized consumerdevice determined by the computerized consumer device.
 19. The system ofclaim 11, further comprising a remote computer processor at a remotecomputer system, the remote computer processor being configured to:analyze test results from multiple instances of the visual acuity testtaken by multiple users; and update the lookup table to adjust entriesthereof based on said analyzing.
 20. The system of claim 11, wherein thecomputerized consumer device comprises tablet computer, a smart phone,or a personal computer.
 21. A non-transitory computer readable mediumcomprising program instructions for permitting a computerized consumerdevice to carry out a visual acuity test of a user, the programinstructions when executed causing a computer processor of thecomputerized consumer device to: initiate a visual acuity test to assessthe visual acuity of a user using the computerized consumer device, thecomputerized consumer device including a display screen, a camera, amicrophone, a speaker, a computer processor, and a memory, the userbeing a human subject; determine a separation distance between a userand the computerized consumer device based on an image size of aphysical feature of the person using imagery of the user taken by thecamera of the computerized consumer device; instruct the user to adjustthe separation between the user and the computerized consumer device,and instruct the user that a predetermined separation distance range isachieved; present a visual acuity test to the user without use of arefractor lens assembly, wherein presenting the visual acuity testcomprises displaying predetermined optotypes at the display screen ofthe computerized consumer device for the user to perceive; record spokenidentifications by the user of perceptions of the predeterminedoptotypes via the microphone of the computerized consumer device, andprovide real-time feedback to the user of detection of the spokenindications by the computerized consumer device; carry out speechrecognition on the user's spoken identifications to generate convertedtext corresponding to the spoken identifications; compare recognizedwords of the converted text to permissible words corresponding to thepredetermined optotypes using a lookup table; determine a score forvisual acuity test taken by the user based on said comparing; anddetermine whether the user passed the visual acuity test based on thescore.
 22. The non-transitory computer readable medium of claim 21,wherein the lookup table comprises multiple entries of permissible wordsfor at least a given one of the predetermined optotypes.
 23. Thenon-transitory computer readable medium of claim 21, the programinstructions being configured to cause the computer processor to controlthe computerized computer device to: display a silhouette of anapproximate head shape of predetermined size on the display screen andactivating the camera; instruct the user to position the computerizedconsumer device relative to the user while displaying the user's imagedhead in real-time relative to the silhouette to provide real-timefeedback to user for proper positioning of computerized consumer device;determine that at least one of a separation distance between the userand the computerized device and a camera alignment relative to theuser's face satisfy thresholds for capturing eye surface images; andcapture imagery of eye surfaces of the user's eyes using the camera ofthe computerized consumer device.
 24. The non-transitory computerreadable medium of claim 23, the program instructions being configuredto cause the computer processor to control the computerized computerdevice to capture the imagery of the eye surfaces of the user's eyes by:processing imagery of the user's eyes by real-time image analysis todetect that an orientation of the user's eyes are in a proper position;acquiring still imagery of the user's eyes with the user's eyes being inthe proper position; and storing the still imagery for designation aseye-surface imagery.
 25. The non-transitory computer readable medium ofclaim 23, the program instructions being configured to cause thecomputer processor to control the computerized consumer device tocapture the imagery of the eye surfaces of the user's eyes by capturingthe imagery of the eye surfaces simultaneously from multiple cameras atthe computerized consumer device, the multiple cameras being spacedapart from one another to thereby obtain the imagery of the eye surfacesfrom multiple different orientations.
 26. The non-transitory computerreadable medium of claim 21, the program instructions being configuredto cause the computer processor to control the computerized computerdevice to: acquire a speech sample of the user using the microphone ofthe computerized consumer device with the user and computerized consumerdevice being separated by the predetermined separation distance range;calculate a voice quality metric based on audio processing of the speechsample; and determine whether the voice quality metric is sufficient topermit visual acuity testing prior to displaying the predeterminedoptotypes on the display screen of the computerized consumer device. 27.The non-transitory computer readable medium of claim 21, the programinstructions being configured to cause the computer processor to controlthe computerized computer device to suspend an automated brightnesscontrol of the display of the computerized device prior to presentingthe visual acuity test.
 28. The non-transitory computer readable mediumof claim 21, the program instructions being configured to cause thecomputer processor to control the computerized computer device todisplay the predetermined optotypes at the display screen of thecomputerized consumer device without changing a size of thepredetermined optotypes displayed on the display screen based on theseparation distance between the user and the computerized consumerdevice determined by the computerized consumer device.
 29. Thenon-transitory computer readable medium of claim 21, further comprisingprogram instructions to cause a remote computer processor at a remotecomputer system to: analyze test results from multiple instances of thevisual acuity test taken by multiple users; and update the lookup tableto adjust entries thereof based on said analyzing.
 30. Thenon-transitory computer readable medium of claim 21, wherein thecomputerized consumer device comprises tablet computer, a smart phone,or a personal computer.
 31. A method for testing visual acuity of a userusing a graphical interface and an audio interface at a computerizedconsumer device, the method comprising: initiating a visual acuity testto assess the visual acuity of a user using a computerized consumerdevice, the computerized consumer device comprising a display screen, acamera, an audio interface including a microphone and a speaker, acomputer processor, and a memory, the user being a human subject, thevisual acuity test comprising a graphical interface for displayinginformation to the user and for receiving input from the user via touchsensitive fields; displaying, via the graphical interface, distanceinformation of a measured distance between the computerized consumerdevice and the user measured from imagery of the user captured by thecamera of the computerized consumer device to thereby provide guidanceto the user to move to a desired predetermined distance range, thegraphical interface being configured to dynamically display the distanceinformation in real time as the measured distance changes; displaying,via the graphical interface, the visual acuity test without use of arefractor lens assembly including displaying predetermined optotypes forthe user to perceive, and presenting audio instructions for the visualacuity test via the speaker of the audio interface; recording, via themicrophone of the audio interface, spoken identifications by the user ofperceptions of the predetermined optotypes, and providing real-timevisual feedback to the user via the graphical interface indicative ofdetection of the spoken indications by the computerized consumer device;carrying out speech recognition on the user's spoken identifications togenerate converted text corresponding to the spoken identifications;comparing recognized words of the converted text to permissible wordscorresponding to the predetermined optotypes using a lookup table;determining a score for visual acuity test taken by the user based onsaid comparing; and determining whether the user passed the visualacuity test based on the score.
 32. The method of claim 31, comprising:displaying, via the graphical interface, a silhouette of an approximatehead shape of predetermined size superimposed with imagery of the useracquired in real-time with the camera to provide real-time feedback touser for proper positioning of computerized consumer device; determiningthat at least one of a separation distance between the user and thecomputerized device and a camera alignment relative to the user's facesatisfy thresholds for capturing eye surface images; notifying the userwith at least one or a visual indication and an audio indication ofachieving the proper positioning; and capturing imagery of eye surfacesof the user's eyes using the camera of the computerized consumer device.33. The method of claim 32, comprising capturing the imagery of the eyesurfaces simultaneously from multiple cameras at the computerizedconsumer device, the multiple cameras being spaced apart from oneanother to thereby obtain the imagery of the eye surfaces from multipledifferent orientations.